Yes, you should pul one and replace. Pull the second one and replace it. The Phase inverter, V3. Which one made the greatest change in the noise?
Since I do not know your experience with electronics, I am considering you still learning tube amps. Have you confirmed your bias on power tubes since installing new ones?
It is common for ALL v1 tubes to make an amp more quite, but it is you specific hum you want to listen for.
After you have a good ear for what happens, go here:
http://www.geofex.com/ampdbug/ampdebug.htmThere is a list of symptoms. Check each one and let us know one(s) seem spot on. Since the amp is 9 or 10 years old, it is possible to have a bad filter cap, but they usually last longer unless someone damaged it in some way.
Do not let the condition of the inside fool you, if it were really perfect you wouldn't have a problem. I have seen quite amps that look bad and loud amps that look great. Just get a filter cap Positive near a pot and you will be humming. Doesn't take much. There is a lot of current inside the chassis.
Next, you want to get voltages. Have a DMM I guess, if not go get one. The cheap one is fine, with tubes we are looking for close enough, not perfect. And a Cheap one is fine until one day you change a cap value and prefer the tonal change. Then you get the Amp Virus and you will probably start collecting old crap, but I digress!
Connect the black lead to ground. Chassis lip is fine. You must be careful as the amp must be running all on into a dummyload or speaker. If the speaker, you will hear a pop sometimes. Doesn't hurt anything.
Measure
V1
Pin 1
Pin 2
Pin 3
These are DC
The other half
Pin 6
Pin 7
Pin 8
Switch to AC and put the black on 4-5 and red on 9 or the other way, doesn't matter. Should be close to 6.3vac
Pin 1 generally reads high as it is the plate and so does pin 6.
Move to V2 and B
Do the same
V3 A and B
Do the same.
Power tubes are V4.V5, V6 and V7.
Measure
Pin 3 (This one should be the highest on all Power Tubes.)
Pin 4
Pin 5