
then export them as CSV to a private gist.Īs you can see in the screenshot, we had one CSV file per competitor and each line was associated with a course. retrieve the data with a cron job of a few lines of Ruby hosted on Heroku,. 1 or 2 years ago, we were working on a first version of this tool ( spoiler alert: we quickly stopped using it because it was not user friendly at all).įor this first iteration we chose the following technical solution: bonus: have general statistics on our competitors (number of training courses, average price, etc.).Īs you know, we highly value pragramatism. bonus: trace the price changes (or other attribute) of a training,. bonus: list the training courses corresponding to a keyword (by displaying useful information such as price, duration, etc.),. bonus: list the courses that probably work best (based on the number of comments, ratings, etc.),. follow the modifications of certain attributes (price, duration, title, program, etc.),. follow new additions / deletions of training,. We had in mind to have the following features: It was time to think outside the box! So we thought about a tool to automate our tracking of our competitors (and price intelligence). For example, it’s impossible to find out about all the new training courses for a competitor who provides several dozens or even hundreds of trainings in their catalog.
Even if we are sometimes lucky enough to be the only ones providing training on specific topics in France, most of the time, there are competitors.įor example, when we are working on a new training, it is interesting to look at what the competition is doing to position ourselves in terms of price, duration, SEO… Until now, we did it by hand when needed, but it was fairly incomplete.
Finally, there is no anti-scraping protection on our site, so enjoy ❤️ Re-imagining monitoring toolsĪs you probably know, our job is professional training for developers. We only use this data internally, and nothing is published. This tool only uses the public data available on their site, legally. The method used is not specific to our market and as we had fun coding all of this, we decided to share it with the world :)ĭisclaimer: We are always very respectful of our competitors. We have developed a tool to stay up to date with developments in the product catalog (in this case, the training) of our competitors. Today we’re going to talk about automated analysis of competition.