Its akin to judging a man by the color of his skin instead of by the content of his character.
Thanks for your comment that clarifies how genetics provides a much more granular window into an individual than any physical characteristic taken by itself can provide.
Or it could be discrimination. There are studies that show that black and white mixed races children did not score any higher than children with two black parents, while white people score higher than black people on average, which may point to some discrimination impacting IQ.
I don't find it that tricky, intelligence does come from the brain.
> That's like equating the workings of my bicycle to my decision to ride to a particular place
Both one's brain and one's "intelligence" belong to the same person, like, physically and materially, which is not true when it comes to your bicycle example. More to the point, I find the comparison itself kind of self-describing, it's like deciding to "outsource" intelligence to some other external, non-ethereal entity (like a bicicle that is physically separate from a human being) in order to avoid those hard questions the OP was alluding to (hard questions that oftentimes also involve the political side of things).
The thing is that no matter how fancy your bicycle, I can still ride my shitty bicycle to a university, and you can ride your lubricated carbon fiber bicycle into a ditch, and then you're not so smart. If what you call intelligence is how fast your bicycle typically goes into the ditch, then sure, it can be measured on a scale and you have more of it.
There are other notions about the transfer of ideas: https://www.apa.org/monitor/2010/06/memory-transfer
Wait, cannibal worms that eat memories? My my.
(Rocks don't have ideas.)