Congrats on the new Watch. There's quite a number of threads around here already and you really should check them out for great advice and pics.
In short, all Apple Watch bands are compatible with all Apple Watch cases - the main issue is whether the colour and/or texture matches or looks good with your Watch case. eg your Rose Gold would've had a Rose Gold matching pin on the Sport Band, but all the other Sport Bands sold by Apple separately have silver stainless steel pins (except for one in black).