First, yes, your understanding is correct. Second, you asked for the vector form of gradient descent. The one I wrote above (the very first formula) is the vector form :-) GD Formula for vector and scala are exactly the same!
Maybe this is what you are looking for… (I found this image from Google.)