Lab 5: Time Series with Transformers

Download the files for Lab 2B from the following links: We recommend that you use Google Colab, as training will be faster on the GPU. To enable the GPU on Colab, go to Edit / Notebook settings / Hardware accelerator / select T4 GPU Instructions on how to download and use Jupyter Notebooks can be … Read more

Lab 2B

Download the Jupyter Notebook for this lab in the following link. Download the data for the lab in the following link . Instructions on how to download and use Jupyter Notebooks can be found here. You can find a static version of the notebook below. Lab2B_notebook Convolutional Neural Networks¶ A convolutional neural network (CNN) is … Read more

Fully Connected Neural Networks

Using linear parameterizations can be seen to fail even when the model is linear if we don’t have enough data. In this post, we will see that neural networks (NN) can success in learning non-linear models, but this is only true if we have sufficient data. In this post we will work with the simplest … Read more

Training Models with PyTorch

Download in pdf format We consider a learning problem with input observations $\bbx\in\reals^n$ and output information $\bby\in\reals^m$. We use a linear learning parametrization that we want to train to predict outputs as $\hby=\bbH\bbx$ that are close to the real $\bby$. The comparison metric between $\bby$ and $\hby$ is the squared Euclidean error $\ell(\bby, \hby) = … Read more