They don't attend in a formal sense. Of course, if they are curious or interested in a matter that's before the Federation Chamber, they are able to attend as a visitor in the same way as members of the public, but I can't say I can recall having seen a senator in the Federation Chamber while I've been there.
On April 30th, 2019. See this statement in context.