Answer: no. most times, you can call, email, (whatever way you use to contact) the manager and ask to reschedule an interview and explain why.
Explanation: most managers are able to reschedule at a later time and it doesn't minimise your chances of getting hired.