There’s a question that comes up in every multi-modal perception system, usually in the first week of design, and it never has a clean answer: where in the pipeline do you fuse your sensor data? The classical framing gives you three options. Early fusion: combine raw inputs upfront. Late fusion: let each modality produce its own predictions, then merge. Mid fusion: extract features independently, then combine somewhere in the middle. Every survey paper draws the same three diagrams. And then you’re on your own. ...
This is my first post in this space and I would hope it were special but I am trying not to worry about being perfect rather making it exist first. This post has less of notes and more of an idea and I hope to prove myself to be correct about it. Overview Time and again, mankind has turned to mother nature for inspiration. And, one of the wonders of nature is evolution. The fact that tiny nudges and changes over millions and billions of years turned a pool of nitrogen based compounds into massive exo-skeletons made of flesh housing a computing powerhouse capable of producing the cave paintings at Lascaux, Moonlight Sonata and carving out an entire temple form a single rock. Yes, the Kailasha Temple at Ellora Caves. There is indeed something special about this 1.3kg mass of grey and white matter. The thing that fills me with awe is the neuroplasticity. If we did not have this feature, we would be mere machines that dared not look to the stars. This is going to be my topic of discussion today and my attempt to getting you excited about devices that interact with the world. ...
I’ve started and killed a few blogs over the years. The endeavours face the same pattern every time. Write a handful of posts trying to be helpful to some imaginary audience, get in my own head about it and then quit. The problem was the bar I was using. “Would a stranger on the internet find this useful?” is a terrible filter. It pushes you toward tutorials nobody asked for. So I changed the question. Now it is, “If someone’s deciding whether to put me in a room with their hardest problems, does this post help them make that call?” ...