Yes, you can! You only need to connect to the server, nothing else. Once you connected, you can go AFK or minimize TF2 and do other things. You will still always earn points and be able to get item drops.