1. (35 points) Implementing di erent optimizers for a fully connected network. Com-plete the Optimization.ipynb Jupyter notebook. Print out the entire workbook and relevant code and submit it as a pdf to gradescope. Download the CIFAR-10 dataset, as you did in HW #2 and #3.
2. (35 points) Implementing batch normalization for a fully connected network. Com-plete the Batch-Normalization.ipynb Jupyter notebook. Print out the entire workbook and relevant code and submit it as a pdf to gradescope.
3. (30 points) Implementing dropout for a fully connected network, and optimizing it. Complete the Dropout.ipynb Jupyter notebook. Print out the entire workbook and relevant code and submit it as a pdf to gradescope.
1
