Sunday, 15 September 2013

Modelling an all-time greatest musical playlist

The popularity of Triple J's annual Hottest 100 has made my wonder what my favourite songs of all time are and whether I could come up with a list based on some actual data. The information I have to use is my iTunes data since 2005. Being only 8 years of my life, this data set is limited. But with any luck (that is, if the assumptions hold true) the following algorithms will stay appropriate into the future and require only minor tweaking. What we're trying to do is come up with a method that will tell me, from my listening habits in iTunes, what my favourite songs are. Whether you actually listen to your favourite songs more than others is a debate for another time.

iTunes doesn't tell you when songs were played, just how many times, so the useful parameters we can export for each song are "Play Count" (p) and "Date Added". If we add up all the individual play counts, we get the "Total Play Count" for the entire collection (P). Date Added can be turned into the number of days the song has been in the collection - time (t). We also know the number of songs in the collection now (N) and at various times in the past when I've exported the data.

First cut:
An easy first-cut model is to simply divide each song's play count by its time in the collection and order the songs by this rate of play. As a first attempt this may seem logical, however the problem is that it is heavily biased towards newer songs. You're likely to listen to a song a few times after you add it before it slips back into your various playlists. It also doesn't take into account that there are more songs in the collection now than at the start.

What we need to do is come up with an equation that tells us how many times a song is expected to have been played depending on when it was added. We can then compare this number to how many times it was actually played and order the songs by this ratio.

Second cut:

This second version suffers from the same biasing problem as the first, but does take into account that the number of songs in the collection is changing over time. This is important as if you assume that you listen to music for about the same amount of time each day, then the more songs you have in your collection, the less likely you are to randomly hear the same song twice. Hence, songs that are played regularly when the collection is small should not be treated in the same way as songs played with the same frequency when the collection is large. N0 is the number of songs in the collection at t0. This model assumes that the number of songs in the collection grows linearly over time (A and B are constants) - that is, the same number of songs are added each month. This is about right for my collection. The integration is left as an exercise for the reader (hint, you get a log function).

Third cut:

This final version takes into account that when you add new songs to your collection that you like, you are likely to listen to them quite a lot, independently of the number of songs that are already there - that is, they get added to a "new songs" playlist. The novelty of a new song eventually wears off, so the way we've modelled this is to use an exponential factor. You can tweek the coefficients (C and D) by thinking about the "half life" of a new song. The integration is left as an exercise for the reader (hint, you get a log function and an exponential).

The equation now contains two components - the first modelling the number of plays expected through random play and the second the impact of adding new songs to the collection. The model suggests that I play the same number of songs each year (apart from a barely perceptible increase due to the exponential factor) and it seems to work pretty well. This model won't work if and when I swap over to streaming music, as opposed to owning it, as my major form of music consumption, but for now it's holding up. Having played around with the coefficients, the list as it stands is below. It pretty much represents upbeat songs I go running with and songs my 2-year old likes - for whatever reason, he likes Korean pop music! I have to think that the novelty of Psy will wear off over time, but Hall and Oates, they'll never die.

Gangnam Style PSY
I Remember Deadmau5 and Kaskade
ABC News Theme Remix Pendulum
You Make My Dreams Hall & Oates
Shooting Stars Bag Raiders
This Boy's In Love The Presets
Get Shaky Ian Carey Project
From Above Ben Folds
Banquet Bloc Party


  1. Replies
    1. hello everyone this is real i want to tell the whole world about DR SALATO HERBAL CREAM that helped me enlarge my penis size ..i have been trying since 18 years of age to enlarge my penis but none rendered me the help i want i have used vaccines,penis pump,surgery,online creams from USA SAMOA,CANADA CAMBODIA,AUSTRALIA and many more but none of them enlarge my penis i was really frustrated and tired of living because my penis was too small ,imagine a cute and handsome 36years old man like me having 3.5 inches and to make it worse i was having erectile dysfunction which was so annoying to me,my girlfriends have left me because of my small penis GOD be the glory as i was searching for help on a facebook page i saw one mr EDDY ZACK from italy testifying of how DR SALATO MIXTURE CREAM enlarge his penis and healed his father PROSTRATE CANCER .so i quickly visited his website link and message him on his email i saw on the website and he replied me and gave me comforting words and told me all i need to do and i was surprise he did not ask for money ,,i got his cream and he sent it to me through united parcel service (UPS)and i got it 4 days later and used the cream just as he told me and its just 1 days of using his herbal mixture my penis is now 11 inches long and 8.0 flaccidity am so happy to feel like a man in the bedroom at last so if you need penis enlargement,,HIV/AIDS,HERPES CURE.DIABETES 1/2.HEPATITIS B,breast enlargement,weak erection,erectile dysfunction cure and many sexual relation cure do not hesitate to email him now or website you can also call or whatsapp him on +2348103629945 thanks

    2. hello everyone i am from AUSTRIA penis enlargement and erectile dysfunction has been a problem to me for more than 5 years,my wife always get disappointed with me when ever we have sex in bed,i don’t last for up to three minute,during sex, i have taking different medication but to no solution,then i went on the net for a solution on how to enlarge my penis and i got DR SALATO who help in cure erection and ejaculation problem with his product and also help to enlarge penis,i got in touch with him through his email or website ,he replied me and gave me steps to follow and i got his herbal product. which i took for just 2 weeks and my premature ejaculation is now normal and my erection is hard and my penis got bigger up to 10 inches and 6.5 girth than before and now i can last long in bed. now 10.5 inches long on erection and off course very large round. I am very happy for this Penis Enlargement experience no side effect
      with DR SALATO you are in safe hands your healing is assured or
      website you can call/whatsapp number: +2348103629945 thanks

    3. Hello every out there,i am here to testify of the wonderful work Dr SALATO
      has done for me with is herbal medicine, in the past years i have being
      going through hard times in any relationship am into, because of the small
      size of my penis which was not big enough to satisfy any woman, so which
      always end up in series of breakup in my relationship with women,because of
      this i have tried so many drugs to enlarge my penis but did not work out,
      then i decided to search online for solution to my problem and I came
      across so many testimony on how Dr SALATO have helped them find solution to
      their problems,so i visit his website ,i told him about my small penis and ejaculation issue, he told me not to
      worry that he will help me to be a real man again, i did not believe he can
      help me but i gave him a try,he told me what to do and then send me his
      herbal cream and liquid medicine which i used for two weeks and my penis enlarge to 10 inches and last longer in bed now and i am a happy man. He can also cure diabetes,H.I.V and any kind of sickness you have. you can contact him on his email on (
      website also for call or
      Whatsapp ( +2348103629945. ) This will be the end
      of your sexual problems and other problems.

  2. Toblay movie songs is really a best web site for latest songs as well as movies use this web site from many days. Greatest website for song lovers, here you can find latest audio songs also old songs. This website service very best. You can download instantly songs

  3. Your blogs and every other content are thus interesting and helpful it makes me return back again.

  4. Quickly this site will indisputably be famous among all blogging people, because of its fastidious articles or reviews.student discount at foot locker

  5. Your blogs and every other content are thus interesting and helpful it makes me return back again.cordless vacuum cleaners

  6. Keep it up!! You have done the nice job having provided the latest information.billboard advertising costs uk

  7. Cool blog site friend I'm about to suggest this to all my listing cleaners

  8. I don’t waste my free time that’s why I read the informative things when I got this blog I really enjoyed reading could try here

  9. Hey buddies, such a marvelous blog you have made I’m surprised to read such informative stufcheck these guys out

  10. I know this is quality based blogs along with other stuff. criminal lawyers

  11. I guess this blog is perfectly company

  12. If you should be opting for finest contents like me, just visit this blog site daily because it provides the feature contents, thanks.Mark Curry payday loan

  13. I feel happiness to read the content that you are

  14. Thanks for sharing out such a great informative content are extremely fastidious.
    tubemate download

  15. It is a life that would become centered around a great mystery of how the musical talent would blossom into a recognized and celebrated gift; a life that would alter the musical landscape and the spiritual worship realm in a short 24 days, and a life that would become so influential that it would dictate musical compositions for many years spotify follower

  16. Master the Mind know what the image means; it no more has the power to override our feelings and measures. This is not because we now have overpowered it, but rather due to the fact we now have included the training or meaning powering the graphic.

  17. You have really selected the suitable topic; this is one of my favorite blogs.

  18. There are numerous types of genitals pants as well as vaginal area briefs. Largely Schamlippenverkleinerung, the alluring pussy is constructed of soft, meats-like Sylikon. For a lifelike sensation to the wearer. Guy just slides in, puts his thing in the genitals and off you chooses to go. The penis is already so inside the pussy how the glans to the clitoris displays. So if person desires to inspire his best item, he just must experiment around the clit

  19. Boy that’s some hardcore quantitative approach. I, however can remember the most played songs in that time on tips. These songs take you back in time like nothing else. Also I cannot believe Gangam Style is this old. تجميل

  20. Looking for the best site for Vidmate Download ? Vidmate Official site is the right place for you! Vidmate is the best app that lets you download videos and songs from YouTube, Facebook, Twitter, etc and various other sites.

  21. You have touched good quality points here. In whatever way continue writing.Scott Lanzon Knoxville

  22. Baliqq as one of the best official dominoqq game websites in Indonesia, with a modern security and defense system and the best server with a high percentage of winning opportunities that can make you feel safe and comfortable joining us and also a specially designed game system between member vs member that collide to the point that you can feel the sensation of playing more exciting. domino99

  23. Understanding musical expression is key to becoming a great guitar player and musician. When you control emotion in music, you will gain the power to greatly affect the listener's experience.spotipromo

  24. For the most part, these companies do a good job of providing access to a large amount of information. vitality cbd

  25. Nice blog, thank you so much for sharing such an amazing blog with us. Visit for the best Website Designing and SEO Services in Delhi, India.
    SEO Service in Delhi

  26. This is a nice Site to watch out for and we provided information on
    vidmate make sure you can check it out and keep on visiting our Site.

  27. Impressive and powerful suggestion by the author of this blog are really helpful to me. Modelling Agency Lagos

  28. My partner and i still can not quite assume that I could be one of those reading through the important recommendations found on this blog. My family and I are sincerely thankful for your generosity and for presenting me potential to pursue the chosen career path. Appreciate your sharing the important information I acquired from your web-site. شمس المعارف

  29. All thanks to Dr Osebor for helping me out from shame. I was heartbroken because i had very small penis, not nice to satisfy a woman, i had so many relationship curt off because of my situation, i have used so many product which i found online but none could offer me the help i searched for. i saw some few comments about this Doctor called Dr. Osebor and I decided to email him on: so I decided to give his herbal product a try. i emailed him and he got back to me, he gave me some comforting words with his herbal product for Penis Enlargement,when i receive his product and i start using it Within 1 week of it, i began to feel the enlargement of my penis, " and now it's just 2 weeks of using his products my penis is about 9 inches longer and strong. I'm so happy..feel free to contact DR Osebor on any types of probles you sick for on his Email: or you can also call him on the phone +2348073245515

  30. Hello viewers around the Globe, I was despondent because i had a very small penis, about 2.5 inches soft and 4 inches hard not nice enough to satisfy a woman, i have been in so many relationship, but cut off because of my situation, i have used so many product which doctors prescribe for me, but none could offer me the help i searched for. i saw some few comments on the internet about this specialist called Dr, OLHIA and i decided to contact him on his {} so I decided to give his herbal product a try. i emailed him and he got back to me, he gave me some comforting words with his herbal pills for Penis Enlargement, Within 3 week of it, i began to feel the enlargement of my penis, " and now it just 4 weeks of using his products my penis is about 9 inches longer, and i had to settle out with my Ex girlfriend Ella, i was surprised when she said that she is satisfied with my sex and i have got a large penis. Am so happy, thanks to Dr OLIHA I also learn that Dr OLIHA also help with Breast Enlargement Hips and Bums Enlargement etc.. If you are in any situation with a little Penis, weak ejaculation, small breast_hips_bums do get to Dr OLIHA now for help on his email {} or whats app him number: +2349038382931