Using reinforcement learning from scratch to teach a computer to play Tic-Tac-Toe Image by author (created with ChatGPT)It appears that everyone in the AI sector is currently honing their Reinforcement Learning (RL) skills, especially in Q-learning, following the recent rumours about OpenAI’s new AI model, Q* and I’m joining in too. However, rather than speculating…

A guide for developers and architects especially those who are not specialized in machine learning to design an MLOps architecture for their organization Introduction According to Gartner’s findings, only 53% of machine learning (ML) projects progress from proof of concept (POC) to production. Often there is a misalignment between the strategic objectives of the company…

The dos and don’ts of processing data in the age of AI 10 min read · 23 hours ago Image by Gilles Lambert on UnsplashThe digital economy has been built on the wonderful promise of equal, fast, and free access to knowledge and information. It has been a long time since then.…

Where the assumptions behind the two-tower model architecture break — and how to go beyond (Image created by the author using generative AI)Two-tower models are among the most common architectural design choices in modern recommender systems — the key idea is to have one tower that learns relevance, and a second, shallow, tower that learns…

A Spotify Data Scientist’s guide to developing a job-hunting strategy that can get you offers A snapshot of the survey I conducted on Blind — Image by AuthorI recently ran a survey among data scientists and found out this shocking number — 86% are blindly sending out job applications, and hoping for the best. Hoping…

Learn about Radial Treemaps and create your own with Python Radial-Treemap by Nick GerendThe Treemap Concept The “Treemap” was introduced by Ben Shneiderman at the University of Maryland in the early 1990s¹. Simply put, it’s an efficient way of displaying hierarchical data as a set of nested rectangles. Although the concept is simple, the arrangement…

Reinforcement learning without the boilerplate code Created by the author with Leonardo Ai.In my previous articles about reinforcement learning, I have shown you how to implement (deep) Q-learning using nothing but a bit of numpy and TensorFlow. While this was an important step towards understanding how these algorithms work under the hood, the code tended…

Three stories about the data career journey “The number 12 is considered a cosmic number — marking the 12 months, the 12 signs of the zodiac, and the 12 stations of the Moon and the Sun” [Photo by Michael Skok on Unsplash]In my previous position, I created end-of-year reports for my business colleagues and CEOs.…

A deep exploration of TiDE, its implementation using Darts and a real life use case comparison with DeepAR (a Transformer architecture) As industries continue to evolve, the importance of an accurate forecasting becomes a non-negotiable asset wether you work in e-commerce, healthcare, retail or even in agriculture. The importance of being able to foresee what…

Data Visualization, Data Storytelling Simplify your overwhelmed charts by using slope charts: a tutorial in Python Altair Image by AuthorWe may plot charts to include as many concepts as possible in our visualization. As a result, our chart could be difficult to read and distracting. For this reason, before plotting anything, sit in your chair…