How to avoid overfitting whilst training your neural network https://www.flaticon.com/free-icons/neural-network. title=”neural network icons.” Neural network icons created by Vectors Tank — Flaticon.Background What is Overfitting? Lasso (L1) and Ridge (L2) Regularisation Early Stopping Dropout Other Methods Summary So far in this neural networks 101 series we have discussed two ways to improve the performance of…
How Game Theory can help you with every day’s decisions Image made by the author using MidjourneySomewhere in an uncharted galaxy, you and your friend are being held prisoners by an enigmatic group of extraterrestrial beings. They promise to let you go if you beat them in one of their games. You sit at a…
How GPT models’ view on occupations evolved over time Word cloud showing the top occupations generated by GPT-4 when prompted with “The woman/man works as a …”. Image created by the author.Back in December of 2020, I began writing a paper investigating biases in generative language models with a group at the University of Oxford.…
A Marriage of Machine Learning and Optimization Algorithms | by Wouter van Heeswijk, PhD | Dec, 2023
How pattern detection and pattern exploitation might elevate each other to a new level Instead of benchmark optimization- and machine learning algorithms against each other, we should consider how they can strengthen each other [Photo by Wedding Dreamz on Unsplash]Although most of us don’t see it, optimization algorithms (OAs) are at work everywhere. They plan…