95 civic starts directly from solenoid to battery but not with key

My 95 civic ex manual was siting in garage for a
couple of years and now it won't start by turning
the ignition switch to start position. The switch
works on Acc and ON position as it gets power to
dashboard lights and fan at ON position. When the
key is turned to start position it dims the lights
inside but it does not start. However when the
battery's hot terminal is connected directly to the
solenoid above the starter it starts and runs fine
until I turn the car off by turning the key. No issues
while driving it continously for 3 hours.
Checked the fuse box everything seems fine,
switched main relay from my friends car, still
doesn't start. Any of the experts here can give me
some advice ? Thanks