DynamicCompressedSensing.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Dynamic Compressed Sensing via Approximate Message Passing\n",
    "\n",
    "Article from J. Ziniel and P. Schniter, 2013 ([link](https://arxiv.org/pdf/1205.4080.pdf))\n",
    "\n",
    "Context: ENSAE Project - 3A : Compressed Sensing  \n",
    "Teacher: Guillaume Lecué  \n",
    "Author of this notebook: Guillaume Demonet"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Introduction\n",
    "\n",
    "__TODO__ : remind a few steps from the article, then introduce the implementation goals, finally refer to the experimentation"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Implementation\n",
    "\n",
    "__TODO__: explain, detail the structure + show a few extracts"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Experimentation\n",
    "\n",
    "### Step 1: generated signal\n",
    "\n",
    "In order to confirm the validity of our implementation, as well as check the algorithm's behavior in a \"simple\" case, we generate a signal and measurements according to a set of model parameters, that we provide to the algorithm as well.  \n",
    "Furthermore, we make sure to not use EM to update these parameters during the passes."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "from dcsamp.signal_gen import SignalGen"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "gen = SignalGen()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "x, theta, s = gen.generate_signal()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "y, A, sig2e = gen.generate_measurements(x)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "from dcsamp.core import DCS_AMP\n",
    "from dcsamp.updater import TestUpdater"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "alg = DCS_AMP(updater=TestUpdater())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "import logging"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "logging.basicConfig(level=logging.DEBUG)\n",
    "#logging.getLogger('AMP').setLevel(logging.INFO)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "DEBUG:Timer(default):(init) took 0.00s\n",
      "DEBUG:MSG:Array [into t=0] lambda_fwd of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=0] pi_in of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=0] psi_in of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] eta_fwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] xi_in of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:AMP:Running AMP at t=0\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 0.99985835729101713, max: 0.99999998169220072)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 0.030705778574093501, max: 0.99956644297911257)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1.446632687445491e-25, max: 0.99760391721974351)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 0.96282386854329793)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 0.80864548258759328)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 0.73161447925233425)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 0.41471580728116908)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 2.2730973669485894e-11)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 4.4833730874106575e-74)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:MSG:Running (across) from 0 to 1\n",
      "DEBUG:MSG:Array [across t=0] pi of shape (1024,) (min: 0.999999999999999, max: 0.999999999999999)\n",
      "DEBUG:MSG:Array [across t=0] psi of shape (1024,) (min: 300136283.88611352, max: 300136283.88611352)\n",
      "DEBUG:MSG:Array [across t=0] xi of shape (1024,) (min: (-91204087982047.438+23696460519147.496j), max: (105377987754517.44+2914046836152.459j))\n",
      "DEBUG:MSG:Array [into t=1] lambda_fwd of shape (1024,) (min: 0.89999999999999003, max: 0.89999999999999003)\n",
      "DEBUG:MSG:Array [into t=1] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=1] pi_in of shape (1024,) (min: 0.89999999999999003, max: 0.89999999999999003)\n",
      "DEBUG:MSG:Array [into t=1] kappa_fwd of shape (1024,) (min: 0.99999999730122613, max: 0.99999999730122613)\n",
      "DEBUG:MSG:Array [into t=1] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=1] psi_in of shape (1024,) (min: 0.99999999730122613, max: 0.99999999730122613)\n",
      "DEBUG:MSG:Array [into t=1] eta_fwd of shape (1024,) (min: (-273488.0229992494+71057.1015274784j), max: (315990.4142048427+8738.1709063679937j))\n",
      "DEBUG:MSG:Array [into t=1] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=1] xi_in of shape (1024,) (min: (-273488.0229992494+71057.1015274784j), max: (315990.41420484264+8738.1709063679937j))\n",
      "DEBUG:AMP:Running AMP at t=1\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\amp.py:71: RuntimeWarning: overflow encountered in exp\n",
      "  gam_C * gam_B\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 1 to 2\n",
      "DEBUG:MSG:Array [across t=1] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=1] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=1] xi of shape (1024,) (min: (-15918.061320683408+5520.2122238453221j), max: (12489.915636040685-2545.3815815923535j))\n",
      "DEBUG:MSG:Array [into t=2] lambda_fwd of shape (1024,) (min: 0.008695652173921058, max: 0.008695652173921058)\n",
      "DEBUG:MSG:Array [into t=2] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=2] pi_in of shape (1024,) (min: 0.0086956521739210597, max: 0.0086956521739210597)\n",
      "DEBUG:MSG:Array [into t=2] kappa_fwd of shape (1024,) (min: 0.99999207415662728, max: 0.99999207415662728)\n",
      "DEBUG:MSG:Array [into t=2] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=2] psi_in of shape (1024,) (min: 0.99999207415662728, max: 0.99999207415662728)\n",
      "DEBUG:MSG:Array [into t=2] eta_fwd of shape (1024,) (min: (-246136.81961439259+63950.753350138439j), max: (284388.65216595615+7864.2546799079064j))\n",
      "DEBUG:MSG:Array [into t=2] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=2] xi_in of shape (1024,) (min: (-246136.81961439259+63950.753350138439j), max: (284388.65216595621+7864.2546799079064j))\n",
      "DEBUG:AMP:Running AMP at t=2\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 2 to 3\n",
      "DEBUG:MSG:Array [across t=2] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=2] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=2] xi of shape (1024,) (min: (-4828.5285521961605+81.467033966102917j), max: (4121.8172140526376+443.74070820474361j))\n",
      "DEBUG:MSG:Array [into t=3] lambda_fwd of shape (1024,) (min: 0.0086956521739130523, max: 0.0086956521739130523)\n",
      "DEBUG:MSG:Array [into t=3] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=3] pi_in of shape (1024,) (min: 0.0086956521739130523, max: 0.0086956521739130523)\n",
      "DEBUG:MSG:Array [into t=3] kappa_fwd of shape (1024,) (min: 0.99998565653506177, max: 0.99998565653506177)\n",
      "DEBUG:MSG:Array [into t=3] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=3] psi_in of shape (1024,) (min: 0.99998565653506177, max: 0.99998565653506177)\n",
      "DEBUG:MSG:Array [into t=3] eta_fwd of shape (1024,) (min: (-221520.96010593502+57555.094597192372j), max: (255947.29418964672+7077.7639957919373j))\n",
      "DEBUG:MSG:Array [into t=3] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=3] xi_in of shape (1024,) (min: (-221520.96010593502+57555.094597192372j), max: (255947.29418964672+7077.7639957919373j))\n",
      "DEBUG:AMP:Running AMP at t=3\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 3 to 4\n",
      "DEBUG:MSG:Array [across t=3] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=3] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=3] xi of shape (1024,) (min: (-31958.87088859158+11609.068698385199j), max: (29712.97392358154+29238.515672684523j))\n",
      "DEBUG:Timer(default):(forward-0) took 0.16s\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "INFO:dcsamp.core:DCS-AMP: forward pass - iteration 0/5\n",
      "\tTotal elapsed time: -4.20s\n",
      "\tPass duration: 0.16s\n",
      "\tAvg. residual energy: 2639372921130574675968.00000\n",
      "\n",
      "\n",
      "\n",
      "DEBUG:Timer(default):(forward-0) took 0.17s\n",
      "DEBUG:MSG:Array [into t=2] lambda_fwd of shape (1024,) (min: 0.008695652173921058, max: 0.008695652173921058)\n",
      "DEBUG:MSG:Array [into t=2] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=2] pi_in of shape (1024,) (min: 0.0086956521739210597, max: 0.0086956521739210597)\n",
      "DEBUG:MSG:Array [into t=2] kappa_fwd of shape (1024,) (min: 0.99999207415662728, max: 0.99999207415662728)\n",
      "DEBUG:MSG:Array [into t=2] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=2] psi_in of shape (1024,) (min: 0.99999207415662728, max: 0.99999207415662728)\n",
      "DEBUG:MSG:Array [into t=2] eta_fwd of shape (1024,) (min: (-246136.81961439259+63950.753350138439j), max: (284388.65216595615+7864.2546799079064j))\n",
      "DEBUG:MSG:Array [into t=2] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=2] xi_in of shape (1024,) (min: (-246136.81961439259+63950.753350138439j), max: (284388.65216595621+7864.2546799079064j))\n",
      "DEBUG:AMP:Running AMP at t=2\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 2 to 2\n",
      "DEBUG:MSG:Array [across t=2] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=2] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=2] xi of shape (1024,) (min: (-4828.5285521961605+81.467033966102917j), max: (4121.8172140526376+443.74070820474361j))\n",
      "DEBUG:MSG:Array [into t=1] lambda_fwd of shape (1024,) (min: 0.89999999999999003, max: 0.89999999999999003)\n",
      "DEBUG:MSG:Array [into t=1] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=1] pi_in of shape (1024,) (min: 0.89999999999999003, max: 0.89999999999999003)\n",
      "DEBUG:MSG:Array [into t=1] kappa_fwd of shape (1024,) (min: 0.99999999730122613, max: 0.99999999730122613)\n",
      "DEBUG:MSG:Array [into t=1] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=1] psi_in of shape (1024,) (min: 0.99999999730122613, max: 0.99999999730122613)\n",
      "DEBUG:MSG:Array [into t=1] eta_fwd of shape (1024,) (min: (-273488.0229992494+71057.1015274784j), max: (315990.4142048427+8738.1709063679937j))\n",
      "DEBUG:MSG:Array [into t=1] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=1] xi_in of shape (1024,) (min: (-273488.0229992494+71057.1015274784j), max: (315990.41420484264+8738.1709063679937j))\n",
      "DEBUG:AMP:Running AMP at t=1\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 1 to 1\n",
      "DEBUG:MSG:Array [across t=1] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=1] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=1] xi of shape (1024,) (min: (-15918.061320683408+5520.2122238453221j), max: (12489.915636040685-2545.3815815923535j))\n",
      "DEBUG:MSG:Array [into t=0] lambda_fwd of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=0] pi_in of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=0] psi_in of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] eta_fwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] xi_in of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:AMP:Running AMP at t=0\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:MSG:Running (across) from 0 to 0\n",
      "DEBUG:Timer(default):(backward-0) took 0.13s\n",
      "INFO:dcsamp.core:DCS-AMP: backward pass - iteration 0/5\n",
      "\tTotal elapsed time: -4.20s\n",
      "\tPass duration: 0.13s\n",
      "\tAvg. residual energy: 12690907442636410541245290206218330046464.00000\n",
      "\n",
      "\n",
      "\n",
      "DEBUG:Timer(default):(backward-0) took 0.13s\n",
      "DEBUG:MSG:Array [into t=0] lambda_fwd of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=0] pi_in of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=0] psi_in of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] eta_fwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] xi_in of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:AMP:Running AMP at t=0\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:MSG:Running (across) from 0 to 1\n",
      "DEBUG:MSG:Array [across t=0] pi of shape (1024,) (min: 0.999999999999999, max: 0.999999999999999)\n",
      "DEBUG:MSG:Array [across t=0] psi of shape (1024,) (min: 300136283.88771057, max: 300136283.88771057)\n",
      "DEBUG:MSG:Array [across t=0] xi of shape (1024,) (min: (-5.2626763123053484e+32-1.3474556767489915e+32j), max: (4.4420844379620615e+32-4.143592123567743e+31j))\n",
      "DEBUG:MSG:Array [into t=1] lambda_fwd of shape (1024,) (min: 0.89999999999999003, max: 0.89999999999999003)\n",
      "DEBUG:MSG:Array [into t=1] lambda_bwd of shape (1024,) (min: 0.050000000000000433, max: 0.050000000000000433)\n",
      "DEBUG:MSG:Array [into t=1] pi_in of shape (1024,) (min: 0.32142857142854925, max: 0.32142857142854925)\n",
      "DEBUG:MSG:Array [into t=1] kappa_fwd of shape (1024,) (min: 0.99999999730122613, max: 0.99999999730122613)\n",
      "DEBUG:MSG:Array [into t=1] kappa_bwd of shape (1024,) (min: 126203.34585150477, max: 126203.34585150477)\n",
      "DEBUG:MSG:Array [into t=1] psi_in of shape (1024,) (min: 0.99999207364386045, max: 0.99999207364386045)\n",
      "DEBUG:MSG:Array [into t=1] eta_fwd of shape (1024,) (min: (-1.5780859961156769e+24-4.0405314856475996e+23j), max: (1.3320202173028074e+24-1.2425131845042261e+23j))\n",
      "DEBUG:MSG:Array [into t=1] eta_bwd of shape (1024,) (min: (-17686.734800759343+6133.569137605914j), max: (13877.684040045206-2828.2017573248372j))\n",
      "DEBUG:MSG:Array [into t=1] xi_in of shape (1024,) (min: (-1.5780734919029166e+24-4.0404994698604456e+23j), max: (1.3320096628309728e+24-1.2425033392554533e+23j))\n",
      "DEBUG:AMP:Running AMP at t=1\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 1 to 2\n",
      "DEBUG:MSG:Array [across t=1] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=1] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=1] xi of shape (1024,) (min: (-15918.061320683408+5520.2122238453221j), max: (12489.915636040685-2545.3815815923535j))\n",
      "DEBUG:MSG:Array [into t=2] lambda_fwd of shape (1024,) (min: 0.008695652173921058, max: 0.008695652173921058)\n",
      "DEBUG:MSG:Array [into t=2] lambda_bwd of shape (1024,) (min: 0.050000000000000433, max: 0.050000000000000433)\n",
      "DEBUG:MSG:Array [into t=2] pi_in of shape (1024,) (min: 0.0004614674665440417, max: 0.0004614674665440417)\n",
      "DEBUG:MSG:Array [into t=2] kappa_fwd of shape (1024,) (min: 0.99999207415662728, max: 0.99999207415662728)\n",
      "DEBUG:MSG:Array [into t=2] kappa_bwd of shape (1024,) (min: 126203.34585150477, max: 126203.34585150477)\n",
      "DEBUG:MSG:Array [into t=2] psi_in of shape (1024,) (min: 0.99998415062482116, max: 0.99998415062482116)\n",
      "DEBUG:MSG:Array [into t=2] eta_fwd of shape (1024,) (min: (-1.4202635029343752e+24-3.6364427639860017e+23j), max: (1.1988064683815991e+24-1.1182509268885001e+23j))\n",
      "DEBUG:MSG:Array [into t=2] eta_bwd of shape (1024,) (min: (-5365.0317246624008+90.518926629003246j), max: (4579.7969045029313+493.04523133860403j))\n",
      "DEBUG:MSG:Array [into t=2] xi_in of shape (1024,) (min: (-1.4202522493421423e+24-3.6364139502877271e+23j), max: (1.198796969525131e+24-1.1182420663214862e+23j))\n",
      "DEBUG:AMP:Running AMP at t=2\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 2 to 3\n",
      "DEBUG:MSG:Array [across t=2] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=2] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=2] xi of shape (1024,) (min: (-4828.5285521961605+81.467033966102917j), max: (4121.8172140526376+443.74070820474361j))\n",
      "DEBUG:MSG:Array [into t=3] lambda_fwd of shape (1024,) (min: 0.0086956521739130523, max: 0.0086956521739130523)\n",
      "DEBUG:MSG:Array [into t=3] lambda_bwd of shape (1024,) (min: 0.091633466135458919, max: 0.091633466135458919)\n",
      "DEBUG:MSG:Array [into t=3] pi_in of shape (1024,) (min: 0.0086956521739130523, max: 0.0086956521739130523)\n",
      "DEBUG:MSG:Array [into t=3] kappa_fwd of shape (1024,) (min: 0.99998565653506177, max: 0.99998565653506177)\n",
      "DEBUG:MSG:Array [into t=3] kappa_bwd of shape (1024,) (min: 126203.34585150477, max: 126203.34585150477)\n",
      "DEBUG:MSG:Array [into t=3] psi_in of shape (1024,) (min: 0.99998565653506177, max: 0.99998565653506177)\n",
      "DEBUG:MSG:Array [into t=3] eta_fwd of shape (1024,) (min: (-1.2782246486495676e+24-3.2727664723670954e+23j), max: (1.0789152672584744e+24-1.0064159891251899e+23j))\n",
      "DEBUG:MSG:Array [into t=3] eta_bwd of shape (1024,) (min: (-35509.856542879534+12898.965220427999j), max: (33014.415470646156+32487.239636316139j))\n",
      "DEBUG:MSG:Array [into t=3] xi_in of shape (1024,) (min: (-1.2782246486495676e+24-3.2727664723670954e+23j), max: (1.0789152672584744e+24-1.0064159891251899e+23j))\n",
      "DEBUG:AMP:Running AMP at t=3\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 3 to 4\n",
      "DEBUG:MSG:Array [across t=3] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=3] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=3] xi of shape (1024,) (min: (-31958.87088859158+11609.068698385199j), max: (29712.97392358154+29238.515672684523j))\n",
      "DEBUG:Timer(default):(forward-1) took 0.17s\n",
      "INFO:dcsamp.core:DCS-AMP: forward pass - iteration 1/5\n",
      "\tTotal elapsed time: -4.20s\n",
      "\tPass duration: 0.17s\n",
      "\tAvg. residual energy: 50684233858904126805592103966114777876617265852133222121472.00000\n",
      "\n",
      "\n",
      "\n",
      "DEBUG:Timer(default):(forward-1) took 0.18s\n",
      "DEBUG:MSG:Array [into t=2] lambda_fwd of shape (1024,) (min: 0.008695652173921058, max: 0.008695652173921058)\n",
      "DEBUG:MSG:Array [into t=2] lambda_bwd of shape (1024,) (min: 0.050000000000000433, max: 0.050000000000000433)\n",
      "DEBUG:MSG:Array [into t=2] pi_in of shape (1024,) (min: 0.0004614674665440417, max: 0.0004614674665440417)\n",
      "DEBUG:MSG:Array [into t=2] kappa_fwd of shape (1024,) (min: 0.99999207415662728, max: 0.99999207415662728)\n",
      "DEBUG:MSG:Array [into t=2] kappa_bwd of shape (1024,) (min: 126203.34585150477, max: 126203.34585150477)\n",
      "DEBUG:MSG:Array [into t=2] psi_in of shape (1024,) (min: 0.99998415062482116, max: 0.99998415062482116)\n",
      "DEBUG:MSG:Array [into t=2] eta_fwd of shape (1024,) (min: (-1.4202635029343752e+24-3.6364427639860017e+23j), max: (1.1988064683815991e+24-1.1182509268885001e+23j))\n",
      "DEBUG:MSG:Array [into t=2] eta_bwd of shape (1024,) (min: (-5365.0317246624008+90.518926629003246j), max: (4579.7969045029313+493.04523133860403j))\n",
      "DEBUG:MSG:Array [into t=2] xi_in of shape (1024,) (min: (-1.4202522493421423e+24-3.6364139502877271e+23j), max: (1.198796969525131e+24-1.1182420663214862e+23j))\n",
      "DEBUG:AMP:Running AMP at t=2\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "DEBUG:MSG:Running (across) from 2 to 2\n",
      "DEBUG:MSG:Array [across t=2] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=2] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=2] xi of shape (1024,) (min: (-4828.5285521961605+81.467033966102917j), max: (4121.8172140526376+443.74070820474361j))\n",
      "DEBUG:MSG:Array [into t=1] lambda_fwd of shape (1024,) (min: 0.89999999999999003, max: 0.89999999999999003)\n",
      "DEBUG:MSG:Array [into t=1] lambda_bwd of shape (1024,) (min: 0.050000000000000433, max: 0.050000000000000433)\n",
      "DEBUG:MSG:Array [into t=1] pi_in of shape (1024,) (min: 0.32142857142854925, max: 0.32142857142854925)\n",
      "DEBUG:MSG:Array [into t=1] kappa_fwd of shape (1024,) (min: 0.99999999730122613, max: 0.99999999730122613)\n",
      "DEBUG:MSG:Array [into t=1] kappa_bwd of shape (1024,) (min: 126203.34585150477, max: 126203.34585150477)\n",
      "DEBUG:MSG:Array [into t=1] psi_in of shape (1024,) (min: 0.99999207364386045, max: 0.99999207364386045)\n",
      "DEBUG:MSG:Array [into t=1] eta_fwd of shape (1024,) (min: (-1.5780859961156769e+24-4.0405314856475996e+23j), max: (1.3320202173028074e+24-1.2425131845042261e+23j))\n",
      "DEBUG:MSG:Array [into t=1] eta_bwd of shape (1024,) (min: (-17686.734800759343+6133.569137605914j), max: (13877.684040045206-2828.2017573248372j))\n",
      "DEBUG:MSG:Array [into t=1] xi_in of shape (1024,) (min: (-1.5780734919029166e+24-4.0404994698604456e+23j), max: (1.3320096628309728e+24-1.2425033392554533e+23j))\n",
      "DEBUG:AMP:Running AMP at t=1\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 1 to 1\n",
      "DEBUG:MSG:Array [across t=1] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=1] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=1] xi of shape (1024,) (min: (-15918.061320683408+5520.2122238453221j), max: (12489.915636040685-2545.3815815923535j))\n",
      "DEBUG:MSG:Array [into t=0] lambda_fwd of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=0] pi_in of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=0] psi_in of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] eta_fwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] xi_in of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:AMP:Running AMP at t=0\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:MSG:Running (across) from 0 to 0\n",
      "DEBUG:Timer(default):(backward-1) took 0.13s\n",
      "INFO:dcsamp.core:DCS-AMP: backward pass - iteration 1/5\n",
      "\tTotal elapsed time: -4.20s\n",
      "\tPass duration: 0.13s\n",
      "\tAvg. residual energy: 273071369063807666283546214398644183897966191536671045910298777891610604601344.00000\n",
      "\n",
      "\n",
      "\n",
      "DEBUG:Timer(default):(backward-1) took 0.13s\n",
      "DEBUG:dcsamp.core:Debug avg_res_en = 2.7307136906380767e+77\n",
      "DEBUG:dcsamp.core:Array sig2e of shape (1024,) (min: 0.0010222452013971886, max: 0.0010222452013971886)\n",
      "DEBUG:dcsamp.core:Debug noise_energy = 0.26169477155768028\n",
      "DEBUG:MSG:Array [into t=0] lambda_fwd of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=0] pi_in of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=0] psi_in of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] eta_fwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] xi_in of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:AMP:Running AMP at t=0\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:MSG:Running (across) from 0 to 1\n",
      "DEBUG:MSG:Array [across t=0] pi of shape (1024,) (min: 0.999999999999999, max: 0.999999999999999)\n",
      "DEBUG:MSG:Array [across t=0] psi of shape (1024,) (min: 300136373.92538571, max: 300136373.92538571)\n",
      "DEBUG:MSG:Array [across t=0] xi of shape (1024,) (min: (-2.4505342649066885e+51-8.7352480383546331e+50j), max: (2.3078221481987664e+51-5.349106700164096e+49j))\n",
      "DEBUG:MSG:Array [into t=1] lambda_fwd of shape (1024,) (min: 0.89999999999999003, max: 0.89999999999999003)\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "DEBUG:MSG:Array [into t=1] lambda_bwd of shape (1024,) (min: 0.095000000000000001, max: 0.095000000000000001)\n",
      "DEBUG:MSG:Array [into t=1] pi_in of shape (1024,) (min: 0.48579545454542689, max: 0.48579545454542689)\n",
      "DEBUG:MSG:Array [into t=1] kappa_fwd of shape (1024,) (min: 0.9999999973012268, max: 0.9999999973012268)\n",
      "DEBUG:MSG:Array [into t=1] kappa_bwd of shape (1024,) (min: 69725.768410924124, max: 69725.768410924124)\n",
      "DEBUG:MSG:Array [into t=1] psi_in of shape (1024,) (min: 0.99998565560696218, max: 0.99998565560696218)\n",
      "DEBUG:MSG:Array [into t=1] eta_fwd of shape (1024,) (min: (-7.3482623989321686e+42-2.6193836839915203e+42j), max: (6.9203205839187091e+42-1.6040028574825368e+41j))\n",
      "DEBUG:MSG:Array [into t=1] eta_bwd of shape (1024,) (min: (-18566.184799364422+6438.5529251889175j), max: (14567.733919072934-2968.8304295785442j))\n",
      "DEBUG:MSG:Array [into t=1] xi_in of shape (1024,) (min: (-7.3481570123991824e+42-2.6193461175914616e+42j), max: (6.9202213347964128e+42-1.6039798533638931e+41j))\n",
      "DEBUG:AMP:Running AMP at t=1\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 1 to 2\n",
      "DEBUG:MSG:Array [across t=1] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=1] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=1] xi of shape (1024,) (min: (-15918.061320683408+5520.2122238453221j), max: (12489.915636040685-2545.3815815923535j))\n",
      "DEBUG:MSG:Array [into t=2] lambda_fwd of shape (1024,) (min: 0.008695652173921058, max: 0.008695652173921058)\n",
      "DEBUG:MSG:Array [into t=2] lambda_bwd of shape (1024,) (min: 0.095000000000000001, max: 0.095000000000000001)\n",
      "DEBUG:MSG:Array [into t=2] pi_in of shape (1024,) (min: 0.00091996320147279568, max: 0.00091996320147279568)\n",
      "DEBUG:MSG:Array [into t=2] kappa_fwd of shape (1024,) (min: 0.99999207415662794, max: 0.99999207415662794)\n",
      "DEBUG:MSG:Array [into t=2] kappa_bwd of shape (1024,) (min: 69725.768410924124, max: 69725.768410924124)\n",
      "DEBUG:MSG:Array [into t=2] psi_in of shape (1024,) (min: 0.99997773268962342, max: 0.99997773268962342)\n",
      "DEBUG:MSG:Array [into t=2] eta_fwd of shape (1024,) (min: (-6.6133714644682404e+42-2.3574222543713933e+42j), max: (6.2282275985831534e+42-1.443588449990849e+41j))\n",
      "DEBUG:MSG:Array [into t=2] eta_bwd of shape (1024,) (min: (-5631.8009839927317+95.019863110178548j), max: (4807.5213786157983+517.5612673903438j))\n",
      "DEBUG:MSG:Array [into t=2] xi_in of shape (1024,) (min: (-6.6132766182678582e+42-2.3573884452099503e+42j), max: (6.228138275954594e+42-1.443567746650634e+41j))\n",
      "DEBUG:AMP:Running AMP at t=2\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 2 to 3\n",
      "DEBUG:MSG:Array [across t=2] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=2] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=2] xi of shape (1024,) (min: (-4828.5285521961605+81.467033966102917j), max: (4121.8172140526376+443.74070820474361j))\n",
      "DEBUG:MSG:Array [into t=3] lambda_fwd of shape (1024,) (min: 0.0086956521739130523, max: 0.0086956521739130523)\n",
      "DEBUG:MSG:Array [into t=3] lambda_bwd of shape (1024,) (min: 0.091633466135458919, max: 0.091633466135458919)\n",
      "DEBUG:MSG:Array [into t=3] pi_in of shape (1024,) (min: 0.0086956521739130523, max: 0.0086956521739130523)\n",
      "DEBUG:MSG:Array [into t=3] kappa_fwd of shape (1024,) (min: 0.99998565653506222, max: 0.99998565653506222)\n",
      "DEBUG:MSG:Array [into t=3] kappa_bwd of shape (1024,) (min: 126203.34585150477, max: 126203.34585150477)\n",
      "DEBUG:MSG:Array [into t=3] psi_in of shape (1024,) (min: 0.99998565653506222, max: 0.99998565653506222)\n",
      "DEBUG:MSG:Array [into t=3] eta_fwd of shape (1024,) (min: (-5.9519760939386676e+42-2.1216592742028512e+42j), max: (5.6053500054463768e+42-1.2992168956476998e+41j))\n",
      "DEBUG:MSG:Array [into t=3] eta_bwd of shape (1024,) (min: (-35509.856542879534+12898.965220427999j), max: (33014.415470646156+32487.239636316139j))\n",
      "DEBUG:MSG:Array [into t=3] xi_in of shape (1024,) (min: (-5.9519760939386676e+42-2.1216592742028512e+42j), max: (5.6053500054463768e+42-1.2992168956476998e+41j))\n",
      "DEBUG:AMP:Running AMP at t=3\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 3 to 4\n",
      "DEBUG:MSG:Array [across t=3] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=3] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=3] xi of shape (1024,) (min: (-31958.87088859158+11609.068698385199j), max: (29712.97392358154+29238.515672684523j))\n",
      "DEBUG:Timer(default):(forward-2) took 0.19s\n",
      "INFO:dcsamp.core:DCS-AMP: forward pass - iteration 2/5\n",
      "\tTotal elapsed time: -4.20s\n",
      "\tPass duration: 0.19s\n",
      "\tAvg. residual energy: 1890450160848592153346072121808433039175393521720265329354313816142995108245569867743345883742208.00000\n",
      "\n",
      "\n",
      "\n",
      "DEBUG:Timer(default):(forward-2) took 0.19s\n",
      "DEBUG:MSG:Array [into t=2] lambda_fwd of shape (1024,) (min: 0.008695652173921058, max: 0.008695652173921058)\n",
      "DEBUG:MSG:Array [into t=2] lambda_bwd of shape (1024,) (min: 0.095000000000000001, max: 0.095000000000000001)\n",
      "DEBUG:MSG:Array [into t=2] pi_in of shape (1024,) (min: 0.00091996320147279568, max: 0.00091996320147279568)\n",
      "DEBUG:MSG:Array [into t=2] kappa_fwd of shape (1024,) (min: 0.99999207415662794, max: 0.99999207415662794)\n",
      "DEBUG:MSG:Array [into t=2] kappa_bwd of shape (1024,) (min: 69725.768410924124, max: 69725.768410924124)\n",
      "DEBUG:MSG:Array [into t=2] psi_in of shape (1024,) (min: 0.99997773268962342, max: 0.99997773268962342)\n",
      "DEBUG:MSG:Array [into t=2] eta_fwd of shape (1024,) (min: (-6.6133714644682404e+42-2.3574222543713933e+42j), max: (6.2282275985831534e+42-1.443588449990849e+41j))\n",
      "DEBUG:MSG:Array [into t=2] eta_bwd of shape (1024,) (min: (-5631.8009839927317+95.019863110178548j), max: (4807.5213786157983+517.5612673903438j))\n",
      "DEBUG:MSG:Array [into t=2] xi_in of shape (1024,) (min: (-6.6132766182678582e+42-2.3573884452099503e+42j), max: (6.228138275954594e+42-1.443567746650634e+41j))\n",
      "DEBUG:AMP:Running AMP at t=2\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 2 to 2\n",
      "DEBUG:MSG:Array [across t=2] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=2] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=2] xi of shape (1024,) (min: (-4828.5285521961605+81.467033966102917j), max: (4121.8172140526376+443.74070820474361j))\n",
      "DEBUG:MSG:Array [into t=1] lambda_fwd of shape (1024,) (min: 0.89999999999999003, max: 0.89999999999999003)\n",
      "DEBUG:MSG:Array [into t=1] lambda_bwd of shape (1024,) (min: 0.095000000000000001, max: 0.095000000000000001)\n",
      "DEBUG:MSG:Array [into t=1] pi_in of shape (1024,) (min: 0.48579545454542689, max: 0.48579545454542689)\n",
      "DEBUG:MSG:Array [into t=1] kappa_fwd of shape (1024,) (min: 0.9999999973012268, max: 0.9999999973012268)\n",
      "DEBUG:MSG:Array [into t=1] kappa_bwd of shape (1024,) (min: 69725.768410924124, max: 69725.768410924124)\n",
      "DEBUG:MSG:Array [into t=1] psi_in of shape (1024,) (min: 0.99998565560696218, max: 0.99998565560696218)\n",
      "DEBUG:MSG:Array [into t=1] eta_fwd of shape (1024,) (min: (-7.3482623989321686e+42-2.6193836839915203e+42j), max: (6.9203205839187091e+42-1.6040028574825368e+41j))\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "DEBUG:MSG:Array [into t=1] eta_bwd of shape (1024,) (min: (-18566.184799364422+6438.5529251889175j), max: (14567.733919072934-2968.8304295785442j))\n",
      "DEBUG:MSG:Array [into t=1] xi_in of shape (1024,) (min: (-7.3481570123991824e+42-2.6193461175914616e+42j), max: (6.9202213347964128e+42-1.6039798533638931e+41j))\n",
      "DEBUG:AMP:Running AMP at t=1\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 1 to 1\n",
      "DEBUG:MSG:Array [across t=1] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=1] psi of shape (1024,) (min: 102224.52013971886, max: 102224.52013971886)\n",
      "DEBUG:MSG:Array [across t=1] xi of shape (1024,) (min: (-15918.061320683408+5520.2122238453221j), max: (12489.915636040685-2545.3815815923535j))\n",
      "DEBUG:MSG:Array [into t=0] lambda_fwd of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=0] pi_in of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=0] psi_in of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] eta_fwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] xi_in of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:AMP:Running AMP at t=0\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:MSG:Running (across) from 0 to 0\n",
      "DEBUG:Timer(default):(backward-2) took 0.15s\n",
      "INFO:dcsamp.core:DCS-AMP: backward pass - iteration 2/5\n",
      "\tTotal elapsed time: -4.20s\n",
      "\tPass duration: 0.15s\n",
      "\tAvg. residual energy: 5366559756531108784703331498869435817655600650917462666478338787087805475947947218108378231466147279933629231142010880.00000\n",
      "\n",
      "\n",
      "\n",
      "DEBUG:Timer(default):(backward-2) took 0.15s\n",
      "DEBUG:Timer(default):(update-2) took 0.00s\n",
      "DEBUG:dcsamp.core:Debug avg_res_en = 5.3665597565311088e+117\n",
      "DEBUG:dcsamp.core:Array sig2e of shape (1024,) (min: 0.0010222452013971886, max: 0.0010222452013971886)\n",
      "DEBUG:dcsamp.core:Debug noise_energy = 0.26169477155768028\n",
      "DEBUG:MSG:Array [into t=0] lambda_fwd of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=0] pi_in of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=0] psi_in of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] eta_fwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] xi_in of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:AMP:Running AMP at t=0\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:MSG:Running (across) from 0 to 1\n",
      "DEBUG:MSG:Array [across t=0] pi of shape (1024,) (min: 0.999999999999999, max: 0.999999999999999)\n",
      "DEBUG:MSG:Array [across t=0] psi of shape (1024,) (min: 1.2595230241951491e+29, max: 1.2595230241951491e+29)\n",
      "DEBUG:MSG:Array [across t=0] xi of shape (1024,) (min: (-2.1146688831751577e+85-5.7726119699843782e+84j), max: (2.0590273166052995e+85+5.2733410629064142e+83j))\n",
      "DEBUG:MSG:Array [into t=1] lambda_fwd of shape (1024,) (min: 0.89999999999999003, max: 0.89999999999999003)\n",
      "DEBUG:MSG:Array [into t=1] lambda_bwd of shape (1024,) (min: 0.09050000000000008, max: 0.09050000000000008)\n",
      "DEBUG:MSG:Array [into t=1] pi_in of shape (1024,) (min: 0.47244779582363855, max: 0.47244779582363855)\n",
      "DEBUG:MSG:Array [into t=1] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=1] kappa_bwd of shape (1024,) (min: 51175.542177268551, max: 51175.542177268551)\n",
      "DEBUG:MSG:Array [into t=1] psi_in of shape (1024,) (min: 0.99998045979744909, max: 0.99998045979744909)\n",
      "DEBUG:MSG:Array [into t=1] eta_fwd of shape (1024,) (min: (-1.5110497849563423e+56-4.1248557375962498e+55j), max: (1.4712907579668416e+56+3.7680986099071353e+54j))\n",
      "DEBUG:MSG:Array [into t=1] eta_bwd of shape (1024,) (min: (-19435.968735757051+6740.1846265029544j), max: (15250.19943847709-3107.9134477336497j))\n",
      "DEBUG:MSG:Array [into t=1] xi_in of shape (1024,) (min: (-1.5110202587374797e+56-4.1247751370796438e+55j), max: (1.4712620086474197e+56+3.7680249804970657e+54j))\n",
      "DEBUG:AMP:Running AMP at t=1\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 1 to 2\n",
      "DEBUG:MSG:Array [across t=1] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=1] psi of shape (1024,) (min: 1.7064323638807511e+20, max: 1.7064323638807511e+20)\n",
      "DEBUG:MSG:Array [across t=1] xi of shape (1024,) (min: (-1070567467364654.8+371261267357888.19j), max: (840007905529301.75-171189358954232.94j))\n",
      "DEBUG:MSG:Array [into t=2] lambda_fwd of shape (1024,) (min: 0.008695652173921058, max: 0.008695652173921058)\n",
      "DEBUG:MSG:Array [into t=2] lambda_bwd of shape (1024,) (min: 0.09050000000000008, max: 0.09050000000000008)\n",
      "DEBUG:MSG:Array [into t=2] pi_in of shape (1024,) (min: 0.0008720916226212295, max: 0.0008720916226212295)\n",
      "DEBUG:MSG:Array [into t=2] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=2] kappa_bwd of shape (1024,) (min: 51175.542177268551, max: 51175.542177268551)\n",
      "DEBUG:MSG:Array [into t=2] psi_in of shape (1024,) (min: 0.99998045979744909, max: 0.99998045979744909)\n",
      "DEBUG:MSG:Array [into t=2] eta_fwd of shape (1024,) (min: (-1.3599448064607081e+56-3.7123701638366247e+55j), max: (1.3241616821701575e+56+3.3912887489164218e+54j))\n",
      "DEBUG:MSG:Array [into t=2] eta_bwd of shape (1024,) (min: (-5895.6381741194182+99.471329658884301j), max: (5032.7429259703922+541.80784692942848j))\n",
      "DEBUG:MSG:Array [into t=2] xi_in of shape (1024,) (min: (-1.3599182328637318e+56-3.7122976233716792e+55j), max: (1.3241358077826778e+56+3.3912224824473592e+54j))\n",
      "DEBUG:AMP:Running AMP at t=2\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 2 to 3\n",
      "DEBUG:MSG:Array [across t=2] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=2] psi of shape (1024,) (min: 1.3471834421738646e+17, max: 1.3471834421738646e+17)\n",
      "DEBUG:MSG:Array [across t=2] xi of shape (1024,) (min: (-256375407135.3194+4325571191.1793242j), max: (218851883128.96674+23560843329.126053j))\n",
      "DEBUG:MSG:Array [into t=3] lambda_fwd of shape (1024,) (min: 0.0086956521739130523, max: 0.0086956521739130523)\n",
      "DEBUG:MSG:Array [into t=3] lambda_bwd of shape (1024,) (min: 0.091633466135458919, max: 0.091633466135458919)\n",
      "DEBUG:MSG:Array [into t=3] pi_in of shape (1024,) (min: 0.0086956521739130523, max: 0.0086956521739130523)\n",
      "DEBUG:MSG:Array [into t=3] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=3] kappa_bwd of shape (1024,) (min: 126203.34585150477, max: 126203.34585150477)\n",
      "DEBUG:MSG:Array [into t=3] psi_in of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=3] eta_fwd of shape (1024,) (min: (-1.2239503258146374e+56-3.3411331474529623e+55j), max: (1.1917455139531418e+56+3.0521598740247797e+54j))\n",
      "DEBUG:MSG:Array [into t=3] eta_bwd of shape (1024,) (min: (-35509.856542879534+12898.965220427999j), max: (33014.415470646156+32487.239636316139j))\n",
      "DEBUG:MSG:Array [into t=3] xi_in of shape (1024,) (min: (-1.2239503258146374e+56-3.3411331474529623e+55j), max: (1.1917455139531418e+56+3.0521598740247797e+54j))\n",
      "DEBUG:AMP:Running AMP at t=3\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 3 to 4\n",
      "DEBUG:MSG:Array [across t=3] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=3] psi of shape (1024,) (min: 1.0966873976510715e+18, max: 1.0966873976510715e+18)\n",
      "DEBUG:MSG:Array [across t=3] xi of shape (1024,) (min: (-13813399970692.01+5017721363719.376j), max: (12842668771245.223+12637596395194.082j))\n",
      "DEBUG:Timer(default):(forward-3) took 0.17s\n",
      "INFO:dcsamp.core:DCS-AMP: forward pass - iteration 3/5\n",
      "\tTotal elapsed time: -4.20s\n",
      "\tPass duration: 0.17s\n",
      "\tAvg. residual energy: 57419591772473025984014306605303258210031156825687097656927729908063469570365535276130381562641319792607548115653013192240418757659077464914623563986277381355601920.00000\n",
      "\n",
      "\n",
      "\n",
      "DEBUG:Timer(default):(forward-3) took 0.18s\n",
      "DEBUG:MSG:Array [into t=2] lambda_fwd of shape (1024,) (min: 0.008695652173921058, max: 0.008695652173921058)\n",
      "DEBUG:MSG:Array [into t=2] lambda_bwd of shape (1024,) (min: 0.09050000000000008, max: 0.09050000000000008)\n",
      "DEBUG:MSG:Array [into t=2] pi_in of shape (1024,) (min: 0.0008720916226212295, max: 0.0008720916226212295)\n",
      "DEBUG:MSG:Array [into t=2] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=2] kappa_bwd of shape (1024,) (min: 51175.542177268551, max: 51175.542177268551)\n",
      "DEBUG:MSG:Array [into t=2] psi_in of shape (1024,) (min: 0.99998045979744909, max: 0.99998045979744909)\n",
      "DEBUG:MSG:Array [into t=2] eta_fwd of shape (1024,) (min: (-1.3599448064607081e+56-3.7123701638366247e+55j), max: (1.3241616821701575e+56+3.3912887489164218e+54j))\n",
      "DEBUG:MSG:Array [into t=2] eta_bwd of shape (1024,) (min: (-5895.6381741194182+99.471329658884301j), max: (5032.7429259703922+541.80784692942848j))\n",
      "DEBUG:MSG:Array [into t=2] xi_in of shape (1024,) (min: (-1.3599182328637318e+56-3.7122976233716792e+55j), max: (1.3241358077826778e+56+3.3912224824473592e+54j))\n",
      "DEBUG:AMP:Running AMP at t=2\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 2 to 2\n",
      "DEBUG:MSG:Array [across t=2] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=2] psi of shape (1024,) (min: 1.3471834421738646e+17, max: 1.3471834421738646e+17)\n",
      "DEBUG:MSG:Array [across t=2] xi of shape (1024,) (min: (-1.361250092513288e+19+2.2967039818518042e+17j), max: (1.162015302032343e+19+1.2509858304987758e+18j))\n",
      "DEBUG:MSG:Array [into t=1] lambda_fwd of shape (1024,) (min: 0.89999999999999003, max: 0.89999999999999003)\n",
      "DEBUG:MSG:Array [into t=1] lambda_bwd of shape (1024,) (min: 0.09050000000000008, max: 0.09050000000000008)\n",
      "DEBUG:MSG:Array [into t=1] pi_in of shape (1024,) (min: 0.47244779582363855, max: 0.47244779582363855)\n",
      "DEBUG:MSG:Array [into t=1] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=1] kappa_bwd of shape (1024,) (min: 51175.542177268551, max: 51175.542177268551)\n",
      "DEBUG:MSG:Array [into t=1] psi_in of shape (1024,) (min: 0.99998045979744909, max: 0.99998045979744909)\n",
      "DEBUG:MSG:Array [into t=1] eta_fwd of shape (1024,) (min: (-1.5110497849563423e+56-4.1248557375962498e+55j), max: (1.4712907579668416e+56+3.7680986099071353e+54j))\n",
      "DEBUG:MSG:Array [into t=1] eta_bwd of shape (1024,) (min: (-19435.968735757051+6740.1846265029544j), max: (15250.19943847709-3107.9134477336497j))\n",
      "DEBUG:MSG:Array [into t=1] xi_in of shape (1024,) (min: (-1.5110202587374797e+56-4.1247751370796438e+55j), max: (1.4712620086474197e+56+3.7680249804970657e+54j))\n",
      "DEBUG:AMP:Running AMP at t=1\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e+100, max: 1e+100)\n",
      "DEBUG:MSG:Running (across) from 1 to 1\n",
      "DEBUG:MSG:Array [across t=1] pi of shape (1024,) (min: 9.9920072216264089e-16, max: 9.9920072216264089e-16)\n",
      "DEBUG:MSG:Array [across t=1] psi of shape (1024,) (min: 1.7064323638807511e+20, max: 1.7064323638807511e+20)\n",
      "DEBUG:MSG:Array [across t=1] xi of shape (1024,) (min: (-7.2000897539598324e+25+2.4969135796045637e+25j), max: (5.6494639508662427e+25-1.1513321551116097e+25j))\n",
      "DEBUG:MSG:Array [into t=0] lambda_fwd of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "DEBUG:MSG:Array [into t=0] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=0] pi_in of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=0] psi_in of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] eta_fwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] xi_in of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:AMP:Running AMP at t=0\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "DEBUG:MSG:Running (across) from 0 to 0\n",
      "DEBUG:Timer(default):(backward-3) took 0.13s\n",
      "INFO:dcsamp.core:DCS-AMP: backward pass - iteration 3/5\n",
      "\tTotal elapsed time: -4.20s\n",
      "\tPass duration: 0.13s\n",
      "\tAvg. residual energy: 70332855741521531109729911878298868085877092562185862600936125102158505306925161459601731079934996483015244411547647524206836756703818170150134640481317891197384167756270413414834131316960018224018202374303618871036570511968589538481593414710795293379832638972688045903555859370550105381526635582324736.00000\n",
      "\n",
      "\n",
      "\n",
      "DEBUG:Timer(default):(backward-3) took 0.14s\n",
      "DEBUG:Timer(default):(update-3) took 0.00s\n",
      "DEBUG:dcsamp.core:Debug avg_res_en = 7.0332855741521531e+301\n",
      "DEBUG:dcsamp.core:Array sig2e of shape (1024,) (min: 0.0010222452013971886, max: 0.0010222452013971886)\n",
      "DEBUG:dcsamp.core:Debug noise_energy = 0.26169477155768028\n",
      "DEBUG:MSG:Array [into t=0] lambda_fwd of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=0] pi_in of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=0] psi_in of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] eta_fwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] xi_in of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:AMP:Running AMP at t=0\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: 1e-100, max: 1e-100)\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\amp.py:104: RuntimeWarning: overflow encountered in multiply\n",
      "  z[:] = y - A.dot(mu) + (1 / M) * f_prime.sum() * z\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\amp.py:69: RuntimeWarning: overflow encountered in multiply\n",
      "  - gam_C * (1 + gam_C) * numpy.abs(xi) ** 2\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\amp.py:69: RuntimeWarning: invalid value encountered in multiply\n",
      "  - gam_C * (1 + gam_C) * numpy.abs(xi) ** 2\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\amp.py:71: RuntimeWarning: overflow encountered in multiply\n",
      "  gam_C * gam_B\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\utils.py:48: RuntimeWarning: invalid value encountered in less\n",
      "  arr[arr < _min] = _min\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\utils.py:49: RuntimeWarning: invalid value encountered in greater\n",
      "  arr[arr > _max] = _max\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\amp.py:104: RuntimeWarning: invalid value encountered in multiply\n",
      "  z[:] = y - A.dot(mu) + (1 / M) * f_prime.sum() * z\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\amp.py:81: RuntimeWarning: invalid value encountered in true_divide\n",
      "  mu[:] = gamma_redux * (phi * psi + c * xi) / gam_B\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Running (across) from 0 to 1\n",
      "DEBUG:MSG:Array [across t=0] pi of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [across t=0] psi of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [across t=0] xi of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\messages.py:148: RuntimeWarning: invalid value encountered in true_divide\n",
      "  (eta_from / kappa_from) + (xi / psi)\n",
      "DEBUG:MSG:Array [into t=1] lambda_fwd of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=1] lambda_bwd of shape (1024,) (min: 0.090950000000000072, max: 0.090950000000000072)\n",
      "DEBUG:MSG:Array [into t=1] pi_in of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=1] kappa_fwd of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=1] kappa_bwd of shape (1024,) (min: 63179.916268232759, max: 63179.916268232759)\n",
      "DEBUG:MSG:Array [into t=1] psi_in of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=1] eta_fwd of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:MSG:Array [into t=1] eta_bwd of shape (1024,) (min: (-23992149830.303341+8320219158.6910515j), max: (18825152213.628433-3836470726.5894856j))\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\messages.py:84: RuntimeWarning: invalid value encountered in true_divide\n",
      "  self.psi_in[:, t] * (eta_f / kap_f + eta_b / kap_b)\n",
      "DEBUG:MSG:Array [into t=1] xi_in of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "DEBUG:AMP:Running AMP at t=1\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\amp.py:91: RuntimeWarning: invalid value encountered in less\n",
      "  self._xi_out = numpy.where(pi < self.tau, phi / self.eps, phi)\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\amp.py:92: RuntimeWarning: invalid value encountered in less\n",
      "  self._psi_out = numpy.where(pi < self.tau, c / self.eps ** 2, c)\n",
      "DEBUG:MSG:Running (across) from 1 to 2\n",
      "DEBUG:MSG:Array [across t=1] pi of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [across t=1] psi of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [across t=1] xi of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:MSG:Array [into t=2] lambda_fwd of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=2] lambda_bwd of shape (1024,) (min: 0.090950000000000072, max: 0.090950000000000072)\n",
      "DEBUG:MSG:Array [into t=2] pi_in of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=2] kappa_fwd of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=2] kappa_bwd of shape (1024,) (min: 63179.916268208777, max: 63179.916268208777)\n",
      "DEBUG:MSG:Array [into t=2] psi_in of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=2] eta_fwd of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:MSG:Array [into t=2] eta_bwd of shape (1024,) (min: (-5752094.3656056998+97049.455541873394j), max: (4910208.4241016125+528616.2026096856j))\n",
      "DEBUG:MSG:Array [into t=2] xi_in of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:AMP:Running AMP at t=2\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Running (across) from 2 to 3\n",
      "DEBUG:MSG:Array [across t=2] pi of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [across t=2] psi of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [across t=2] xi of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:MSG:Array [into t=3] lambda_fwd of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=3] lambda_bwd of shape (1024,) (min: 0.091633466135458919, max: 0.091633466135458919)\n",
      "DEBUG:MSG:Array [into t=3] pi_in of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=3] kappa_fwd of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=3] kappa_bwd of shape (1024,) (min: 1.3539350588284833e+18, max: 1.3539350588284833e+18)\n",
      "DEBUG:MSG:Array [into t=3] psi_in of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=3] eta_fwd of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:MSG:Array [into t=3] eta_bwd of shape (1024,) (min: (-15348222189657.789+5575245959688.1953j), max: (14269631968050.248+14041773772437.869j))\n",
      "DEBUG:MSG:Array [into t=3] xi_in of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:AMP:Running AMP at t=3\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Running (across) from 3 to 4\n",
      "DEBUG:MSG:Array [across t=3] pi of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [across t=3] psi of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [across t=3] xi of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:Timer(default):(forward-4) took 0.33s\n",
      "INFO:dcsamp.core:DCS-AMP: forward pass - iteration 4/5\n",
      "\tTotal elapsed time: -4.20s\n",
      "\tPass duration: 0.33s\n",
      "\tAvg. residual energy: nan\n",
      "\n",
      "\n",
      "\n",
      "DEBUG:Timer(default):(forward-4) took 0.33s\n",
      "DEBUG:MSG:Array [into t=2] lambda_fwd of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=2] lambda_bwd of shape (1024,) (min: 0.090950000000000072, max: 0.090950000000000072)\n",
      "DEBUG:MSG:Array [into t=2] pi_in of shape (1024,) (min: nan, max: nan)\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "DEBUG:MSG:Array [into t=2] kappa_fwd of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=2] kappa_bwd of shape (1024,) (min: 63179.916268208777, max: 63179.916268208777)\n",
      "DEBUG:MSG:Array [into t=2] psi_in of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=2] eta_fwd of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:MSG:Array [into t=2] eta_bwd of shape (1024,) (min: (-5752094.3656056998+97049.455541873394j), max: (4910208.4241016125+528616.2026096856j))\n",
      "DEBUG:MSG:Array [into t=2] xi_in of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:AMP:Running AMP at t=2\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Running (across) from 2 to 2\n",
      "DEBUG:MSG:Array [across t=2] pi of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [across t=2] psi of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [across t=2] xi of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "C:\\Users\\demon\\Documents\\ENSAE\\CompressedSensing\\dcs_git\\dcsamp\\messages.py:177: RuntimeWarning: invalid value encountered in true_divide\n",
      "  theta_var * (xi / psi + eta_from / kappa_from) -\n",
      "DEBUG:MSG:Array [into t=1] lambda_fwd of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=1] lambda_bwd of shape (1024,) (min: 0.090950000000000072, max: 0.090950000000000072)\n",
      "DEBUG:MSG:Array [into t=1] pi_in of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=1] kappa_fwd of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=1] kappa_bwd of shape (1024,) (min: 63179.916268232759, max: 63179.916268232759)\n",
      "DEBUG:MSG:Array [into t=1] psi_in of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [into t=1] eta_fwd of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:MSG:Array [into t=1] eta_bwd of shape (1024,) (min: (-23992149830.303341+8320219158.6910515j), max: (18825152213.628433-3836470726.5894856j))\n",
      "DEBUG:MSG:Array [into t=1] xi_in of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:AMP:Running AMP at t=1\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Running (across) from 1 to 1\n",
      "DEBUG:MSG:Array [across t=1] pi of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [across t=1] psi of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Array [across t=1] xi of shape (1024,) (min: (nan+nan*j), max: (nan+nan*j))\n",
      "DEBUG:MSG:Array [into t=0] lambda_fwd of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] lambda_bwd of shape (1024,) (min: 0.5, max: 0.5)\n",
      "DEBUG:MSG:Array [into t=0] pi_in of shape (1024,) (min: 0.080000000000000002, max: 0.080000000000000002)\n",
      "DEBUG:MSG:Array [into t=0] kappa_fwd of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] kappa_bwd of shape (1024,) (min: inf, max: inf)\n",
      "DEBUG:MSG:Array [into t=0] psi_in of shape (1024,) (min: 1.0, max: 1.0)\n",
      "DEBUG:MSG:Array [into t=0] eta_fwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] eta_bwd of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:MSG:Array [into t=0] xi_in of shape (1024,) (min: 0j, max: 0j)\n",
      "DEBUG:AMP:Running AMP at t=0\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:AMP:Array gamma_exp of shape (1024,) (min: nan, max: nan)\n",
      "DEBUG:MSG:Running (across) from 0 to 0\n",
      "DEBUG:Timer(default):(backward-4) took 0.27s\n",
      "INFO:dcsamp.core:DCS-AMP: backward pass - iteration 4/5\n",
      "\tTotal elapsed time: -4.20s\n",
      "\tPass duration: 0.27s\n",
      "\tAvg. residual energy: nan\n",
      "\n",
      "\n",
      "\n",
      "DEBUG:Timer(default):(backward-4) took 0.27s\n",
      "DEBUG:Timer(default):(update-4) took 0.00s\n",
      "DEBUG:dcsamp.core:Debug avg_res_en = nan\n",
      "DEBUG:dcsamp.core:Array sig2e of shape (1024,) (min: 0.0010222452013971886, max: 0.0010222452013971886)\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "DEBUG:dcsamp.core:Debug noise_energy = 0.26169477155768028\n",
      "DEBUG:Timer(default):(global) took 1.92s\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "{'lambda_estimates': [None,\n",
       "  None,\n",
       "  None,\n",
       "  array([ nan,  nan,  nan, ...,  nan,  nan,  nan])],\n",
       " 'v_estimates': [None,\n",
       "  None,\n",
       "  None,\n",
       "  array([ nan,  nan,  nan, ...,  nan,  nan,  nan])],\n",
       " 'x_estimates': [array([ nan+nanj,  nan+nanj,  nan+nanj, ...,  nan+nanj,  nan+nanj,\n",
       "          nan+nanj]),\n",
       "  array([ nan+nanj,  nan+nanj,  nan+nanj, ...,  nan+nanj,  nan+nanj,\n",
       "          nan+nanj]),\n",
       "  array([ nan+nanj,  nan+nanj,  nan+nanj, ...,  nan+nanj,  nan+nanj,\n",
       "          nan+nanj]),\n",
       "  array([ nan+nanj,  nan+nanj,  nan+nanj, ...,  nan+nanj,  nan+nanj,\n",
       "          nan+nanj])]}"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "alg.run(y, A, siggen=gen, sig2e=sig2e)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TODO\n",
    "\n",
    "### Short paper\n",
    "\n",
    "LaTeX document, show essential points from the article as well as references (e.g. Belief Propagation, AMP)\n",
    "\n",
    "If possible, detail the algorithm steps and computation of update rules\n",
    "\n",
    "### Implementation\n",
    "\n",
    "- Find two-three testbeds: \n",
    "  - Theoretical (simulated) from the article first experiment\n",
    "  - Practical from the article (either MRI or audio)\n",
    "  - External practical testbed (videosurveillance enhancement ? video compression scheme ?)\n",
    "\n",
    "\n",
    "- Find possible ready-made implementations:\n",
    "  - For Kalman filters\n",
    "  - For Belief Propagation ?\n",
    "  - For Basis Pursuit\n",
    "\n",
    "\n",
    "- Implement the full DCS-AMP algorithm:\n",
    "  - First using the underlying Bernouilli Gaussian signal model (DCS-BG-AMP)\n",
    "  - Then (if time) allowing the Bernouilli Gaussian-mixture signal model (DCS-GM-AMP)\n",
    " \n",
    "\n",
    "- Compare algorithms on the testbed(s) from the article\n",
    "- Attempt to show interesting results on the external testbed"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.1"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}