There is more than Monte Carlo when talking about randomized algorithms. It is not uncommon to see the expresions "Monte Carlo Approach" and "randomized approach" used interchangeably. More than once you start reading a paper or listening to a presentation, in which the words "Monte Carlo" appear on the keywords and even on the title, … Continue reading On types of randomized algorithms

# Basic Statistics with Sympathy – Part 4: Building arbitrary RNGs in Sympathy

Remember your friend from our very first post? . Well, I am sorry to say that he never really reached French Guyana. He ended up in Carcass, one of the Malvinas/Falkland islands. And his boat was (peacefully) captured by overly friendly pirate penguins. Now he spends his days counting penguins and sheep. He did keep a coin and … Continue reading Basic Statistics with Sympathy – Part 4: Building arbitrary RNGs in Sympathy

# Studying random variables with Doob-Martingales

Or "Martingales are awesome!". In a previous post, we talked about bounds for the deviation of a random variable from its expectation that built upon Martingales, useful for cases in which the random variables cannot be modeled as sums of independent random variables (or in the case in which we do not know if they are … Continue reading Studying random variables with Doob-Martingales

# Useful rules of thumb for bounding random variables (Part 2)

In the previous post we looked at Chebyshev's, Markov's and Chernoff's expressions for bounding (under certain conditions) the divergence of a random variable from its expectation. Particularly, we saw that the Chernoff bound was a tighter bound for the expectation, as long as your random variable was modeled as sum of independent Poisson trials. In … Continue reading Useful rules of thumb for bounding random variables (Part 2)

# Basic Statistics with Sympathy – Part 3: Make & Plot a simple regression with Sympathy

In our previous post, we briefly explored the plotting capabilities built in Sympathy, and also the enormous flexibility that the calculator node brings into our flow. Today we will use those two nodes to build and plot one of the simplest, most widely used models of data: a linear regression. Our flow will simply have … Continue reading Basic Statistics with Sympathy – Part 3: Make & Plot a simple regression with Sympathy

# Useful rules of thumb for bounding random variables (Part 1)

In a previous post we were discussing the pros and cons of parametric and non-parametric models, and how they can complement each other. In this post, we will add a little more into the story. More specifically, we are going to talk about bounds to the probability that a random variable deviates from its expectation. In these … Continue reading Useful rules of thumb for bounding random variables (Part 1)

# Book Chapter Review: If your model is mis-specified, are you better off?

This post is my interpretation of Chapter 10 of the book "Advanced Data Analysis from an Elementary point of view". It is one of the most interesting reads I have found in quite some time (together with this). Actually, the original title for the post was "Book Chapter review: Using non-parametric models to test parametric model … Continue reading Book Chapter Review: If your model is mis-specified, are you better off?

# Basic Statistics with Sympathy – Part 2: Plotting and using the Calculator Node for common functions.

Allow me to introduce you to your new best friend from Sympathy 1.2.x: The improved calculator node. The node takes a list of tables, from which you can establish a new signal with the output for a calculation. There is already a menu with the most popular calculations and a list of signals from the … Continue reading Basic Statistics with Sympathy – Part 2: Plotting and using the Calculator Node for common functions.

# Basic Statistics with Sympathy – Part 1: Statistics and expectations.

Statistics and expectations: When your data is incomplete, somewhat corrupted or you simply need to use a black-box tool, you can help yourself by using statistics...

# Tutorial Series: Basic Statistics with Sympathy – Intro

Ever wanted to extract some statistics from your data, but don't really feel like fiddling with importing, formatting and such in your go-to scripts? or worse: you inherited the scripts from that colleague who just departed to French Guyana for a sailing adventure in his home-made boat. If the previous situation portrays your day-to-day more … Continue reading Tutorial Series: Basic Statistics with Sympathy – Intro