A lot of problems we solve at Squad deal with images. Images to be tagged, labeled, moderated, transcribed etc. And there is this thing about images, they are generally heavier than text, digitally. And if our contractors (users of our app) spend more money on internet packs/plans than what they earn, or if they have … Continue reading Leveraging AWS Lambda for Image Compression at scale
No, I don't think the world at large is interested in what I am doing with my life. But I needed to write this because this question will get asked often internally and because DRY. For the lazy, here is a tl;dr: I missed the team, and the hustle. Platform team was facing acute bandwidth … Continue reading Why Squad: Second Innings
Just me fanboying about my mentor, with the sole purpose of getting more page views on my sad blog when he becomes famous.
Designed by FreepikSometimes when I tell my friends what we have built in a short span of time, I see there eyes going wide in disbelief. One candidate I was talking to about SquadRun thought we had 10–12 developers in the team, judging by what all we had built. But we are not a team … Continue reading How we built an engineering culture of doing more with less
Hacks should be quick. And so should be the articles about them. Photo by Caspar Rubin on Unsplash Problem We needed to calculate medians, percentiles for some quantities for our own ETL system (note to self: write a post on this) grouped by certain fields. Some options we had: Extra: But Django says this will … Continue reading Hack Django ORM to calculate Median and Percentiles (Or make annotations great again!)
Tl;dr: Avoid joins on large tables and evaluate parts of queries beforehand to get 100–10,000x performance gains! As mentioned in a previous post, because of some of our tables growing in size, our queries started performing poorly which resulted in a performance hit to our most used APIs. It was time we revisit some of … Continue reading Blazingly fast querying on huge tables by avoiding joins