Interesting video about Decoupled Attention from Weights

[paulsc.liu]

This video describe an interesting idea:

I Decoupled Attention from Weights - Gemma 4 26B

Maybe I no longer have to be envious of people with multiple Spark.