Photo by Jon Tyson on UnsplashLet us consider a nonlinear function f(x), where x is a continuous variable. We would like to find the minimum value of this function f(x) by changing our decision variable x. The optimization problem can mathematically be formulated in the following manner: In most cases, the user comes across some…

There exist publicly accessible data which describe the socio-economic characteristics of a geographic location. In Australia where I reside, the Government through the Australian Bureau of Statistics (ABS) collects and publishes individual and household data on a regular basis in respect of income, occupation, education, employment and housing at an area level. Some examples of…

Photo by Mathew Schwartz on UnsplashIn the previous article, we discussed the surprising behavior of data in higher dimensions. We found that volume tends to accumulate in the corners of spaces in a strange way, and we simulated a hypersphere inscribed inside a hypercube to investigate this, observing an interesting decrease in their volume ratio…

Understand batch processing from business and technical perspective Photo by Dannie Sorum on UnsplashWe live in a world where every human interaction becomes an event in the system, whether it’s purchasing clothes online or in-store, scrolling social media, or taking an Uber. Unsurprisingly, all these events are processed in one way or the other.…

Gain intuition behind acceleration training techniques in neural networks D eep learning made a gigantic step in the world of artificial intelligence. At the current moment, neural networks outperform other types of algorithms on non-tabular data: images, videos, audio, etc. Deep learning models usually have a strong complexity and come up with millions or even…

What it is and How to apply it to a real-world scenario Photo by Google DeepMind on UnsplashThis year, my resolution is to go back to the basics of data science. I work with data every day, but it’s easy to forget how some of the core algorithms function if you’re completing repetitive tasks. I’m…

Exploring the Transformer’s Decoder Architecture: Masked Multi-Head Attention, Encoder-Decoder Attention, and Practical Implementation This post was co-authored with Rafael Nardi. In this article, we delve into the decoder component of the transformer architecture, focusing on its differences and similarities with the encoder. The decoder’s unique feature is its loop-like, iterative nature, which contrasts with the…

Turn a government PDF into a financial planning tool Photo by Robert Murray on Unsplash!Hierarchical data is a data model where items are linked to each other in parent-child relationships, forming a tree structure. Some obvious examples are family trees and corporate organization charts. A treemap is a diagram that represents hierarchical data using nested…

Not to pick on Sebastian Bubeck in particular, but if auto-complete-on-steroid can “blow his mind,” imagine the effects on the average user. Developers and data practitioners use LLMs every day to generate code, synthetic data, and documentation. They too can be misled by inflated capabilities. It’s when humans over-trust their tools that mistakes happen. TL;DR:…

Photo by Nadine Shaabana on UnsplashDistance as a measure of difference This article discusses three measures of distance: (1) the Earth Mover’s Distance (EMD; Rubner et al., 1998); (2) the Word Mover’s Distance (WMD; Kusner et al., 2015); and (3) the Concept Mover’s Distance (CMD; Stoltz & Taylor, 2019). These measures build on one another…